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PREFACE 






The first report on the SEED project schools was com- 
pleted in August 1970. That report described the SEED work in 
reading achievement for the first grade children. That report 
was for the academic year 1969-1970.* 



ITiis report supplements that first SEED study on 
first grade students. Herein will be found the description of 
second and third grade students for that same academic year. 
During this 1969-1970 year for SEED, only the first grade stu- 
dents were aided instructionally . Hence this report on the se- 
cond and third grade reading reflects the results of the stan- 
dard fare of the San Francisco Board of Education in these 
schools. Only Jedediah Smith and Sir Francis Drake had other 
federal funding, these schools being involved in ESEA Title I 
funding. Together, the two SEED reports on the 1969-1970 aca- 
demic year provide base year data for the study of the 1970- 
1971 academic year's work of SEED. 



The preface of the first report noted the following: 



There is much to admire in the SEED project's efforts 
and educational progress in first grade reading education 
as the reader v/ill see for himself further in this diag- 
nostic review. However, the work of this diagnostic re- 
viewer was hampered by recent policies of the Unified 
School District of San Francisco in relation to the use 
of ability or so called I.Q. tests in the evaluational 
work of programs. Explicitly, Mr. Yvon 0. Johnson's mem- 
orandum of May 11, 1970 is the current embodiment of that 
policy. The complete text of this memorandum is found in 
Appendix I. Its essence is the prohibition of ability tests 
for program evaluation purposes. Though there are many 
reasons v/hy this policy came into being and effect, the 
a* counting for variance in achievement test results is not 
possible without external criterion measures of a stand- 
ardized variety. This v/riter believes that this policy is 
too stringent in character. He also believes that this 
was not the original intent of the board policy, viz . , to 
hamper educational evaluation of programs. Allowance for 
ability tests in program evaluations is not only appropri- 
ate but needed. Ignorance is no substitute for science; 
and the argument from silence is no argument at all. 
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In this report, the sa-ne words obtain and the text of Mr. John- 
son's iTiemorandum is found in the Appendix. 

As in the previous report, I note now my gratitude 
to the Reverend Charles II. Lee, SEED project director, and the 
entire SEED staff for their aid. And to Mr. Robert L. Fisher, 
SEED supervisor of education, I am grateful for his sharing of 
knowledge and experience in el.ementary education, for his inti- 
mate knowledge of the SEED curricula was invaluable. I am also 
grateful for his review of the findings of this report so as to 
check incongruities and errors that might have crept into it 
inadvertent ly . 

To my graduate student and research assistant Bro- 
ther Ronald Lee Roggenback, F.S.C., I am grateful for the bene- 
fit I derived from his statistical labors and thinking that 
sharpened this report. Again, I note with special regard the 
computer programming work of Hugh James Everett, doctoral stu- 
dent in computer sciences in the University of California-Ber- 
keley. His conscientiousness, fortitude, competence, and good 
humor contributed to the success of this report. In addition, 

I am indebted to Misses Helen R. Campbell and Diane Pederson 
whose typing skills made this manuscript a reality. 

To Dr. Robert G, Lamp, Director of the Educational 
Planning Laboratory and my colleague in the Department of Edu- 
cation, I owe much. The opportunity to do this work, the free- 
dom to tackle it as I saw fit, and for his mounds of humane pa- 
tience, I am grateful. To have the opportunity to learn and to 
enjoy that experience is a personal gift for which I can say 
only thanks . 

To my patient and loving family, Anna, Steven and 
George, I extend my affection for understanding. 

The results of this project report res", with me; and 
the responsibility for it is entirely mine. 



JSC 

October 26, 1971 

The University of San Francisco 

San Francisco, California 94117 



*James Steve Counelis, First Grade Students in the Hunters Point - 
B ayview SEED Project; A Diagnostic Review (San Francisco: The 

University of San Francisco-Educational Planning Laboratory, 
August 15, 1970). 



A LIST OF MA.K;)'. I'lTDIMC’,'.; 



The Tt; 1 .low i.nT, LM’id.in;';. (li; th.ls d i 'if'/nor:' Lie review are 
abouL Ll'.c .socuncl and iTiircl e.racie s LiKitni I'.a j.n the SF.ED pro)- 
ecL acliooJ.f; Tor Lhu ac;uleia.ie year 1969-1970. However, it 
must bo noted that SidOl proji.'cl: iunds did not go into cur- 
ricular' development and enrichment for these graded students. 
The first grade atudonts v;ere the first group oi’ students 
upon which the SEED project conecutrated. These findings 
are intended to be a sort of baseline for the second year's 
work of SEITD 'where the sccon'l and third grades v/ould be in- 
cluded, that is for the academic year of 1970-71. Of course 
these findings are subject to the qualifications v;hich arise 
from the variability found at the levels of the school, the 
classroom, and the individual student. 

For the eight SEED project schools in tlie Baysviev;- 
Hunters Point tlie following findings have been found: 

1. On the average, the second grade students at- 
tended 36‘7o of the 181 school year; avtd the third grade 
students attended oST. of the 181 school year. 

2. The mean staninc reading scores for the. second 
grade students was 2.69 v;hich at the upper end of the 
"Helov/ Grade Level" category. 
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3. The mean sLiinine reading scores for the third 
grade students was 2.49 which is at the center of the 
upper end of the "Below Grade Level" category. 

4. The mean grade equivalent score in reading for 
the second grade students was 2,12 which (when compared 
with the normed grade level expected at 2.90) is found 
to be about 8 months below grade. 

5. The mean grade equivalent score in reading for 
the third grade students was 2.56 which (when compared 
with the normed grade level expected at 3.90) is found 
to be about 14 months below grade. 

6. The teachers' subjective and experientially 
based estimates of their pupils' within-grade capacity 
levels were validated by the achievement test scores 
at the one percent level of significance. 

i 

7. There was no significant difference in the mean 
reading stanine scores per school earned by the second 

and third grade students in 1969-1970 from the prior i 

year's students' mean reading stanine scores in the 
same grades for the same schools. 

8. There was no significant difference in mean j 

attendance between boys and girls in both the second | 

and third grades. | 

\ 
j 
'! 

.1 
J 

I 

] 



9. On a per school basis, there was no signifi- 
cant difference between boys and girls in their mean 
stanine reading scores achieved, though on a pooled 
basis for all schools, girls exceeded boys in mean 
reading. stanine scores. 
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INTRODUCTION 



In August 1970, the first diagnostic review of students 
in the SEED project was written and published. Due to admin 
istrative problems in the SEED office, the second and third 
grade students in the program were not studied because the 
data were not made available. It was not until mid-March 
1971 that these became available. Therefore this report sup 
plements the earlier report. The earlier report was: 

James Steve Counelis, First Grade Students in the Hunters 
Point-Bayview SEED Project: A Diagnostic Review (Mimeo- 
graphed report; San Francisco: The Educational Planning 

Laboratory of the University of San Francisco, August 15, 
1970). 

This report on the second and third grade students in 
the SEED project schools is a diagnostic review and not a 
judgment. As a post hoc description with no prior control 
over the design and collection of data, much must be left 
unsaid because to assert more than the data would warrant 
is merely to assert arguments from silence. 



The SEED project schools are eight in number. The 
seven public schools are: (1) Bayview; (2) Bret Hart; 

(3) Burnett; (4) Fremont; (5) Hunters Point II; (6) 
Jedeclic'ih Smith; (7) Sir Francis Drake. All Hallows is 
the one private school in the SEED project and it is a 
Roman Catholic institution. 

This report will provide a descriptive analysis of 
the second and third grade children in the SEED project's 
eight schools. Full and partial records of 624 second 
grade students and 591 third grade students are the basis 
of this diagnostic review. The project had as its goal 
to work on reading and mathematics programs. 



THE EMPIRICAL BASIS FOR THIS DIAGNOSTIC REVIEW 



Through the cooperation and service of the SEED of- 
fice staff, the principals of the several SEED project 
schools and most of the classroom teachers, a set of em- 
pirical data was obtained on the second and third grade 
students under SEED project funding. These data were; 

(1) student's name; (2) student's birthday; month and 
year; (3) student's sex; (4) the number of full days in 
attendance in the program; (5) teacher's estimate of the 
student's reading level; below grade, at grade, and above 
grade levels; (6) the grade for reading assigned by the 
teacher at the end of the school term; (7) the stanine 
score and the grade equivalent score earned by the stu- 
dents on the Stanford Achievement Test; Primary II Read - 
ing Test- Forms W and X , given in Spring 1970. The second 

grade students took Form W of the Stanford Test . The third 

grade students tool Form X of the same test. 

Two other pieces of data were collected; but they were 

not used in this review. These were: (1) teacher's esti- 

mate of student's arithmetic level; below grade, at grade 
and above grade levels; (2) the arithmetic grade assigned 
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by the teacher at the end of the rchool term. Inasmuch as 
an achievement examination in arithmetic had not been ad- 
ministered as it had been for reading, the absence of an 
external criterion measure made it impossible to make a 
1 / reasonable diagnostic opinion on achievement in arithmetic. 



In Dr. Pangloss' best of all possible worlds, complete 
records of every child is not possible. Every researcher 
expects to find a certain number of partial records. But 
‘ it was unfortunate for this diagnostic review that about 

I 27 percent of the second grade children's records and 5 

percent of the third grade children's records are partial 
in respect to significant data. For the second grade 
children, it is particularly difficult to sustain the ab- 
sence of all of the student's records from Jedediah Smith, 
32 percent of the Fremont records, 27 percent of the Bay- 
view records, and 25 percent of the Bret Harte records. 
Likewise, 39 percent of the third grade records from 
Jedediah Smith also compound the problem. Nonetheless, 
these gaps do not constitute an insurmountable deterrent 
toward achieving a limited, reasonable, useful and meaning- 
^ ful diagnostic review. See Tables Nos. 1-4 for the number, 
the i^articular areas of data, as well as the schools and 
classes for which student records are partial to a signifi- 

I 

cant degree. 
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This diagnostic review will not attempt to study the 
several curricular approaches to the teaching of second and 
third grade reading in the SKED schools. These problems are 
not amenable to post hoc educational analysis. . Though very 
complex, such problems are amenable to systematic inquiry, 
given the development and correct installation of the re- 
search design into the reading curricula so that the data 
collection becomes an integral and unobtrusive element 
planned into the learning process of the children. This 
was not the case during this first year of SEED. 
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NON-ACADEMIC CHARACTERISTICS OF SEED SECOND GRADE 



AND THIRD GRADE STUDENTS 

The ethnic composition of the SEED schools typify the 
current industrial slum. The second and third grade stu- 
dents in the Hunters Point-Bayview area schools are over 
90 percent black. See Tables Nos. 5-6 for the ethnic com- 
position of the second and third grade classes for the 1969- 
1970 academic years. This ethnic data of these schools in 
the SEED project was provided by the records of the SEED 
Office staff. 

The overall proportional distribution of boys and girls 
in the 1969-1970 SEED project second graders is 49 and 51 
percent, respectively. The same statistics for the third 
graders is 55 and 45 percent respectively. Hence, the pro- 
portions of boys to girls are reversed for these two grade 
levels. See Tables Nos. 7-8 for the school distributions 
of boys and girls for each grade. 

••i 

As would be expected for students entering a succeed- 
ing grade, the mean age of all second grade student is eight 



years. For all third grade students, the mean age is nine 
years. See Tables Nos. 9-10 for the frequency and proposi- 
tional distribution of second and third grade pupils by 
school and sex. The decimal ages were calculated as of 
June 1970. 



ATTENDANCE PATTERNS 



School attendance is an empirical indicator of the 
child's availability for his opportunity in instruction. 

Of course, the lower the attendance record, the lower the 
pupil's opportunity to learn, given the importance of such 
instruction to the people of the desperate economic circum- 
stances in which the majority of the Hunters Point-Bayview 
parents find themselves. 

But attendance in school is also an empirical indicator 
of the degree of rapport, cordiality, and cooperation be- 
tween parents and the school. The reasoning is, the closer 
the cooperation between the parent and the school, the higher 
the attendance of the child. The higher the attendance of 
the child in school, the greater the opportunity for a given 
child to learn. 

I 

The total number of days in the academic year for the 
1969.irl970 in the San Francisco Unified School District was 
181. For all of the SEED program second graders, the mean 
full days in program was 157 days ; and the range of this 
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statistic for the schools was from the Hunters Point II 
mean of l44 days to All Hallows' mean of 167 days. No 
data were had for Jedediah Smith second grade classes. 

For the SEED project third grade pupils, the mean full 
days in program was 160; and the range was from the Hunters 
Point II low mean of 147 days to the high of Bayview' s mean 
of 171 days. See Tables Nos. 11-12 for these statistics by 
school and sex. 

Attendance can be stated more cogently in terms of the 
percent of the base of 181 days in school. For all schools, 
the second grade pupils had a mean percent of 86. The range 
of this attendance statistic is from Hunters Point II low 
mean of 79 percent to a 92 percent mean for All Hallows, 

The third grade children had a mean percent of 88. The 
range of this attendance statistic is from Bayview' s high 
of 94 percent to Hunters Point II low mean of 81 percent. 

As before, there were no data for the second grade students 
of Jedediah Smith. See Tables Nos. 13-14 for these statis- 
tics by school and by L' k. 

There is another way to look at attendance of SEED 
project students, that being the percent of the number of 
students attending more than 80 percent\of the total school 
year of 181 days. In this regard, 'for ^11 SEED schools' 
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second graders, 86 percent attended school more than 80 
percent of the time. Likev^ise, the statistic for all SEED 
schools' third graders is that 86 percent of the children 
attended more than 80 percent of the time. The range of 
this statistic for second grade pupils is from the Hunters 
Point II statistic of 65 percent of the pupils attending 
80 percent and more of the time to All Hallows statistic 
of 100 percent of their pupils attending more than 80 per- 
cent of the time. The similar statistic for third grade 
students is from Hunters Point II' s 74 percent who attended 
more than 80 percent of the time to Baysview's 100 percent 
who attended more than 80 percent of the time. See Tables 
13-14 for these statistics by school and by sex. 

If there is any one issue upon which the SEED organi- 
zation, the schools and the parents can work cooperatively 
and with immediate results, that issue is improvement of 
attendance. It is important, necessary and vital to young 
lives being molded. It has been suggested that school at- 
tendance is a function of the degree of cooperation exist- 
ing between the school and the parents. It appears that 
much needs to be done in this area. 




TEACHER EVALUATION OF READING 



Under procedures of the Unified School District of 
San Francisco, the evaluation of primary students is done 
on a twofold basis. On her practical but subjective ex- 
perience with the students, the teacher estimates the 
within-grade capacity level of each child. These estimates 
of the within-grade capacity are designated below with a 
numerical score attached to each: 

(a) Above Grade Level: 1; 

(b) At Grade Level: 2; 

(c) Below Grade Level: 3. 

Tables Nos. 15-16 provide the mean of the within-grade teach- 
er estimates of the SEED project second and third grade stu- 
dents for all schools, for individual schools, and by sex. 

A cursory reading of these tables shows that the teachers 
tend to rate their students to be "At Grade Level" or 
slightly below. It appears to be fairly universal as dem- 
onstrated by the fact that the standard deviations vary 
between two- thirds to three-fourths of a grade point. 

Further evidence is given in the frequency distributions 
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of students placed within these categories because more tha i 
one-half of the students tend to be classed within the cate- 
gories ’’Above Grade Level'' and "At Grade Level," though this 
does vary with the particular school and teacher. 

The second part of the teacher evaluation for pri..nary 
students is the assignment of grades within each of the 
within-grade level estimates of student capacity noted above. 
The grades given, with their assigned numerical value, are: 

(a) Excellent = 1; 

(b) Very Good =2; 

(c) Satisfactory = 3; 

(d) Improvement Needed =4. 

In both the first and second grades, however, the grade 
"Excellent" is never awarded. The highest grade possible 
is "Very Good" while the third grade students can be awarded 
the grade of "Excellent." Tables No. 17-18 provide the mean 
grades earned by the second and third grade pupils in the 
SEED project. For the most part, the grades tend toward 
"Satisfactory," the means for the second and third graders 
as groups being 2.87 and 2.72 respectively. The frequency 
distributions of SEED second and third grade students within 
the grade categories given above further supports this con- 
tention because about two-thirds to three-fourths of these 
pupils were placed in .the upper three categories, though 
this varies from school to school. 
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In a collective sense, the SEED teachers' assessment 
of their pupils is quite obvious. These teachers believe 
that their pupils are at grade level and doing satisfac- 
torily. See Tables Nos. 17-18 for the detailed statistics 
upon which this assertion is built. A comparison of these 
assessmeiits will be made with the external criterion of a 
standardized reading test. 
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ACHIEVEMENT TEST RESULTS 



In May 1970, the second and third grade SEED project 
students were tested with the Stanford Reading Achievement 
Examination , Forms W and X being used respectively For 
both grades, two scores were recorded for each, child taking 
the examination: (1) a stanine score; (2) a grade equiva- 

lent score. 

Stanine scores are derived scores which provide use- 
ful categories within which students rank themselves. The 
following within-grade categories are defined in terms of 
stanine scores: 

(a) Below Grade Level: 1, 2, 3; 

(b) At Grade Level: 4, 5, 6; 

(c) Above Grade Level: 7, 8, 9. 

Tables Nos. 19-20 contain the stanine score information 
for both grades for all schools combined, by schools in- 
dividually, and by sex. 



For technical information of these examinations, see 
Truman L. Kelley, et al . , Stanford Achievement Tests: Tech - 
nical Supplement (New York: Harcourt.^ Brace, and World, Inc, 

1966 ^ . 



17 



For all second graders in the SEED schools, the mean 
stanine score was 2.69 which is two- thirds of the way into 
the upper end of the "Below Grade Level" category. Two- 
thirds of the students were in this category while the 
others were distributed among the upper two groups. The 
mean stanine scores for boys and girls combined ranges from 
Hunters Point II at 1.60 to the mean stanine score of 3.59 
for the Burnett boys and girls in the second grade. It is 
noteworthy that Hunters Point II had no students in the 
"At Grade Level" and "Above Grade Level" categories; and 
that Burnett and Sir Francis Drake did not have any students 
in the "Above Grade Level" group. See Table No. 19 for the 
statistics on the second graders by school and by sex. 

For all third grade students combined in the SEED 
schools, the mean stanine score was 2.49 which is just half 
way toward the upper end of the "Below Grade Level" cate- 
gory. Three-quarters of all the third grade students were 
in this lower group, the remaining quarter being found in 
the upper two classes. The mean stanine scores for boys 
and girls combined range from the All Hallows high of 4.45 
s mean stanine to Jedediah Smith's low of 1.74 mean stanine. 

It is useful to note that Bret Harte, Fremont, Jedediah 
Smith, and Sir Francis Drake did not have any students in 
the "Above Grade Level" category. See Table No. 20 for 
the statistics on the third grade pupils by school and sex. 
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As rankings, stanine scores do not provide useful units 
for the layman's i.nterpretation of educational progress be- 
cause it is not a norm or standard that is commonly known 
to him. A means for doing this is the grade equivalent 
score. The grade equivalent score is a decimal number in 
which the whole number represents the grade year and the 
fractional tenths represent the number of calendar school 
months within a ten-month school year. Thus the grade 
equivalent score of 5.6 is interpreted to mean the achieve- 
ment that is commensurate with that found at the sixth 
month of the fifth grade of a given norming population of 
students for a specific subject matter area. Generally, 
the norming population is a very large national sample. 
Tables Nos. 21-22 provide the statistics on the second and 
third graders of the SEED schools in terms of their reading 
achievement by grade equivalent scores. 

Based on national norming populations, it would be 
anticipated that second grade children being tested in the 
ninth month of the second grade would normally earn a grade 
equivalent score in reading achievement in the region of 
2.90 as a group. For all the second grade children in the 
SEED schools, the mean grade equivalent score was 2.12, or 
about eight months behind on the average. This post hoc 
finding does not refer to the rate of- learning that was 
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going on in the SEED schools under its program for the eight 
months that it had been installed, for no pre-test/post- test 
differential is calculable in order to discover this rate. 
See Tables No. 21 for the statistical information on the 
second graders by school and sex; and in Table No. 23 for 
the statistics by school and teacher. 

Again based on national norms, it would be anticipated 
that third grade pupils being tested in the ninth month of 
the third grade would normally earn a grade equivalent score 
in reading achievement in the region of 3.90 as a group. 

For all third grade students in the SEED schools, the mean 
grade equivalent score was 2.56 or about 14 school months 
behind as a group. Again, this post hoc finding does not 
refer to the rate of learning that was going on in the SEED 
project schools during the eight months in which the project 
was operating. This rate is not discoverable because of 
the absence of pre-test data on the students. See Table 
No. 22 for the statistics on the third graders by school 
and sex; and see Table No. 24 for statistics by school and 
teacher. 

4 

The previous section on the teacher subjective evalua- 
tion of their pupils ended with the need to test the teach- 
ers' evaluations against the external criterion of a stand- 
ardized test in reading. Tables Nos. 25 and 26 provide this 
test of association and correlation. 
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The finding is that as a group the teachers' subjec- 
tive evaluation of their pupils as to their with-in grade 
reading capacities is highly associated and correlated with 
the earned stanine scores of their pupils on the Stanford 
tests. The distribution of students in terms of these two 
variables for both grades are statistically significant at 
the one percent level, meaning that these distributions 
could occur by chance only once in one hundred times. The 
correlation between these two variables was measured by a 
Contingency Coefficient C which was calculated to be .48 
for the second graders and .40 for the third graders. 

Given that 3x3 tables yield a maximum C of .82, the C 
value of the second graders was calculated to be 59 percent 
of that maximum value and the C value of the third graders 
was calculated to be 49 percent of that same value. The 
facts that only 394 out of the 624 second graders and 509 
out of the 591 third graders were used in these tests do 
not vitiate this common finding. 
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OTHER FINDINGS 



This section provides a series of findings that are 
relevant and important for interpreting this review report 
as whole. 

Sex-linked Hypothesis ; For both the second and third ' 
grades two hypotheses were tested to determine whether the 
boys and girls in this test population differed signifi- 
cantly in respect to attendance and stanine scores in 
reading. Tables No. 27-30 present Mann-Whitney U tests 
on all of these issues. For both the second and third 
grades, the boys and girls did not significantly differ in 
terms of their attendance to school. However, a different 
finding was found for the reading stanine scores. VThen al ! 
the students from all the schools are pooled, the girls wer 
found to have significantly higher reading stanine scores 
than the boys in both the second and the third grades. Th.; 
is a common finding. However, when individual schools are 
tested, no significant difference in boys' and girls' score 
is noted for either the second or the third grades. 
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Prior Year Comparisons ; The SEED project curriculum 
enrichment was not introduced into the second and third 
grade curriculums during this first year of work. Unlike 
the beginning of positive change found in the first graders 
who were affected by the SEED projects curricular enrich- 
ment programs, the second and third graders continued in 
the standard curriculum of the San Francisco Unified 
School District as it was knov^m in the Baysview-Hunters 
Point schools. Hence if the second and third grade stu- 
dents of the prior academic year were compared with this 
academic year's students, no difference in mean stanine 
scores per school would be expected. That fact was sub- 
stantiated in the data found in Tables Nos. 31-32. For 
both the second and third grade students, a Kruskul-Wallis 
One Way Analysis of Variance Test H statistic was calculated 
and no significant difference, was found between the groups. 
The necessity of this finding is important in relation to 
the following year's anticipation of results for the second 
and third year students' inclusion within the SEED project's 
perview. 

.H 






CONCLUSION 

Nine empirical findings summarize this diagnostic re- 
view. Recorded baldly and for the reader’s convenience at 
the front of this report, these findings reveal a post hoc 
description of the SEED second and third grade students and 
their reading achievement. Again, it must be noted that the 
SEED project did not fund any type of curricular enrichment 
for the second and third grade children in the SEED schools. 
This report will provide baseline data on this academic year 
of 1969-1970 for the following academic year’s evaluation of 
seed’s effect. The reserved comment that one can make on the 
basis of these empirical findings is that the reading curri- 
culum in these schools of the San Francisco Unified School 
District appears to fail in effectiveness across the board. 
There is obvious need for marshalling resources and parental 
involvement in these schools such that intensive instruction- 
al intervention becomes available and effective so as to change 
the lives of these children. 

The nine empirical findings are: 
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1. On the average, the second grade students attended 
86% of the 181 school year; and the third grade students at- 
tended 88% of the 181 school year. 

I 2. The mean stanine reading scores for the second 

! grade students was 2.69 which at the upper end of the "Below 

i Grade Level" category. 

^ 3. The mean stanine reading scores for the third grade 

students was 2.49 which is at the center of the upper end of 
the "Below Grade Level" category. 

4. The mean grade equivalent score in reading for the 
second grade students was 2.12 which (when compared with the 
normed grade level expected at 2.90) is found to be about 8 
months below grade. 

5. The mean grade equivalent score in reading for the 
third grade students was 2.56 which (when compared with the 
normed grade level expected at 3.90) is found to be about 14^ 
months below grade. 

6. The teachers' subjective and experientially based 
estimates of their pupils' within-grade capacity levels were 
validated by the achievement test scores at the one percent 
level of significance. 

7. There was no significant difference in the mean 
reading stanine scores per school earned by the second and 
third grade students in 1969-1970 from the prior year's stu- 
dents' mean reading stanine scores in the same grades for the 
same schools. 

8. There was no significant difference in mean atten- 
dance between boys and girls in both the second and third 
grades . 



9. On a per school basis, there was no significant dif- 
ference between boys and girls in their mean stanine reading 
scores achieved, though on a pooled basis for all schools, 
girls exceeded boys in mean reading stanine scores. 
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APPENDIX 



•\ SAN FRANCISCO UNIFIED SCHOOL 
DISTRICT 

Division of Research and Program 
Evaluation 



MH^ORANDUM 



May 11, 1970 



To: 



Prom 



All Evaluators of Special ProgrcUiis 
Yvon 0. Johnson, Acting Director 



Research and Program EvaD.uation 
Subject: Use of Ability (IQ) Tests in Program Evaluation 



Inasmuch as the primary intent of all special instructional programs 



presently carried on in the San Francisco Unified School District is tc increase 
student achievement in subject-matter content and skills; 



And, inasmuch as the employment, if any, of ability (IQ) tests is only 



to attempt to describe the learning ability of the participating students and is 
not an integral part of the evaluation of student achievement; 



And, inasmuch as there exists concern as to the validity of present 



ability (IQ) tests in measuring the learning potential of ethnic minority and/or 
low-socioeconoraic-status students, and that there is a concern that a self-ful- 
filling prophecy can result when program personnel use these ability (IQ) scores 
as an indication of student learning potential; 



Therefore, the Division of Research and Program Evaluation hereby directs 



all inhouse and contract evaluators of special programs that, as of this date, the 
following statements apply to all present and future special instructional progrcims: 



1. No ability (IQ) tests other than those mandated 
by -the State of California are to be administered 
to progrcim students. 

2. No ability (IQ) test scores, including those 
obtained from State-mandated testing, are to be 
maintained in the special program's data bank or 
records. Existing IQ scores in the program's data 
bank or records are to be removed or blanked out. 

5 . Program evaluators will not furnish ability (IQ) 
scores to program personnel or others. 

4 . Program evaluation reports will not contain ability 
(IQ) scores. 



This directive does not preclude any studies or experiments that attempt 



to develop culture-free or ciilturally relevant tests of learning ability, profi- 
ciency, or potential. Permission for such studies must, of course, be obtained 
through this office. 
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TABLE NO. 1: CHECK SHEET OF DATA OBTAINED ON SEED PROJECT 

SECOND GRADE STUDENTS BY SCHOOL AND CLASSROOM TEACHER 
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TABLE NO. 2; EXTENT OF PARTIAL RECORDS ON SEED PROJECT SECOND GRADE STUDENTS 
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TABLE NO. 4; . EXTENT OF PARTIAL RECORDS ON SEED THIRD GRADE STUDENTS 
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TABLE NO. 5 

SEED PROJECT SECOND GRADE STUDENTS: ETHNIC COMPOSITION, 

BY SCHOOL TYPE FOR ACADEMIC YEAR 1969-1970+ 



ETHNIC CLASSES 
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TABLE NO. 6 

c 

SEED PROJECT THIRD GRADE STUDENTS: ETHNIC COMPOSITION, 

BY SCHOOL TYPE FOR ACADEMIC YEAR 1969-1970+ 


ETHNIC CLASSES 
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TABLE NO. 11: 

SEED PROJECT SECOND GRADE STUDENTS' ATTENDANCE: 

NUMBER OF FULL DAYS IN PROGRAM, MEAN AND STANDARD DEVlATTOfV 



(TOTAL SCHOOL DAYS: 181) 
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SEED PROJECT THIRD GRADE STUDENTS' ATTENDANCE: 
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TABLE NO. 13: SEED PROJECT SECOND GRADE STUDENTS’ PERCENT FULL DAYS IN PROGRAM: 

MEANS, STANDARD DEVIATIONS, FREQUENCY AND PROPORTIONAL DISTRIBUTIONS, BY SCHOOLS AND SEX 
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TABLE NO. 14: SEED PROJECT THIRD GRADE STUDENTS’ PERCENT FULL DAYS IN PKOGRAM: 

MEANS, STANDARD DEVIATIONS, FREQUENCY AND PROPORTIONAL DISTRIBUTIONS, BY SCHOOLS AND SEX 
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TABLE NO. 16: SEED PROJECT THIRD GRADE STUDENTS: TEACHER READING LEVEL 

ESTIMATE WITHIN CLASS, MEANS, STANDARD DEVIATIONS, FREQUENCY AND 
PROPORTIONAL DISTRIBUTIONS, BY SCHOOL AND SEX 
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TABLE NO. 20: 
CONTINUED 
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I I I 

I I I 



VO CO r 



CM Cn| <f 



<J* CM CO 
CTv 



iH CO <J* 
CO CM m 



S.TND 

DEV. 




- 1.50 
1.79 
1.67 
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TABLE EO. 21 

SEED PROJECT SECOND GRADE STUlB’NTS; READING ACHIEVEMENT 
GRADE EQUIVALENT SCORl':S-, MEANS AND STANDARD DEVIATIONS, 

BY SCHOOLS AND SluX 



SCHOOLS 


N 


MEANS 


STANDARD 

DEVIATION 


ALL SCHOOLS 
Boys 


264 


2.07 


.57 


Girls 


273 


2.16 


.58 


Boys & Girls 


537 


2.12 


.58 


ALL HALLOWS 






• 


Boys 


24 . 


2.03 


.48 


Girls 


29 


2.25 


.62 


Boys 6e Girls 


53 


2.15 


.57 


BAYVIEW 








Boys 


38 


1.94 


.56 


Girls 


38 


2.12 


.52 


Boys 6t Girls 


76 


2.03 


.54 


BRET HARTE 








Boys 


29 


2.38 


.97 


Girls 


24 


2.44 


.91 


Boys 6e Girls 


53 


2.40 


.94 


BURNETT 

Boys 


33 


2.35 


.50 


Girls 


42 


2.44 


.50 


Boys 6e Girls 


75 


2.40 


.50 


FREMONT 








Boys 


41 


2.30 


.59 


Girls 


33 


2.40 


.64 


Boys £e Girls 


74 


2.34 


.61 
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table’ NO. 21 

C0NTINU1::D 




SCHOOLS 


N 


MEANS 


STANDARD 

DEVIATION 

■w 


HUNTERS POINT II 
. Boys 


19 


1.81 


.20 


Girls 


16 


1.72 


.22 


Boys & Girls 


35 


1.77 


.21 


JEDEDIAH SMITH 








Boys 


39 


1.93 


.41 


Girls 


37 


1.99 


.36 


Boys 6 c Girls 


76 


• 1.96 


.39 


SIR FRANCIS DRAKE 








Boys 


. 41 


1.81 


.21 


Girls 


54 


1.91 


.36 


Boys 6 c Girls 


95 


1.87 


.31 








• 

6^4 
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TABLE NO. 22 

SEED PROJECT THIRD GRADE STUDENTS: READING ACHIEVEMENT 

GRADE EQUIVALENT SCORES, MEANS, AND STANDARD DEVIATIONS, 

BY SCHOOLS AND SEX 






MEANS 


STANDARD 


SCHOOLS 


N 


DEVIATION 

s, 


^ 








ALL SCHOOLS 








Boys 


289 


2.41 


.76 


Girls 


249 


2.74 


.85 


Boys & Girls 


538 


2.56 


.82 


ALL HALLOWS 








Boys 


29 


3.15 


.79 


Girls 


31 


3.55 


.67 


Boys & Girls 


. 60 


3.36 


.76 


BAYVIEW 








Boys 


40 


2.36 


.99 


Girls 


27 


2.59 


.72 


Boys & Girls 


67 


2.45 


.89 


BRET HARTE 








Boys 


34 


2.44 


.63 


Girls 


31 


2.79 


.64 


Boys & Girls 
BURNETT 


65 


2.61 


.65 


Boys 


41 


2.74 


.73 


Girls 


48 


3.05 


.89 


Boys & Girls 


89 


2.91 


.83 


FREMONT 








Boys 


37 


2.07 


.60 


Girls 


33 


2.47 


.61 


Boys & Girls 


70 


2.26 




.63 
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TABLE NO. 22 






CONTINUED 






- 




MEANS 


STANDARD 


SCHOOLS 


N 


DEVIATION 


HUNTERS POINT II 






_L_ . _ . , 


Boys 


18 


2.23 


.57 


Girls 


20 


2.53 


1.26 


Boys Sc Girls 


38 


2.39 


.99 


JEDEDIAR SMITH 








Boys 


33 


2.18 


.52 


Girls 


25 


2.30 


.54 


Boys 6c Girls 


. 58 


2.23 


.53 


SIR FRANCIS DRAKE 








Boys 


57 


2.22 


.60 


Girls 


34 


2.33 


.66 


Boys 6c Girls 


91 


2.26 


.62 

__ J 
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TABLE EO. 23 

SEED PROJECT SECOND GPxADE CLASSES: ^^1'AN GI^DE EQUIVAI.ENT 

■SCORE AND STANDARD DEVIATION BY ALL SCHOOLS AND BY TEACHERS 

OF INDIVIDUAL CUSSES 


SCHOOL/TEACHER 


STUDENT 

N 


MlilAN GRADE 
EQUIVALENT 
SCORE 


standard 

DEVIATION 

V 


ALL SCHOOLS 


537 


2.12 


.58 


ALL HALLOWS 




2.15 


.57 


(1) Teacher No. 004 


24 


2.38 


.55 


(2) Teacher No. 005 


29 


1.96 


.51 


BAYVIEW 




2.03 


.54 


(1) Teacher No. 012 


19 


1.75 


.28 


(2) Teacher No. 013 


21 


2.19 


.50 


(3) Teacher No. 014 


20 


2.12 


.79 


(4) Teacher No. 015 


16 


2.04 


.32 


BRET HARTE 




2.40 


.94 


(1) Teacher No. 025 


14 


3.63 


.69 


(2) Teacher No. 026 


6 


1.45 


.22 


(3) Teacher No. 027 


20 


1.89 


.32 


(4) Teacher No. 028 


13 


2.31 


.68 


BURNETT 




2.40 


.50 


(1) Teacher No. 038 


24 


2.09 


.42 


(2) Teacher No. 039 


25 


2.56 


.44 


(3) Teacher No. 040 


26 


2.54 


.50 


FREMONT 




2.34 


.61 


(1) Teacher No. 048 


21 


2.43. 


.51 


(2) Teacher No. 049 


25 


1.93 


.45 


(3) Teacher No. 050 


25 


2,76 


.54 


+(4) Teacher No. 051 


3 


1.73 


.06 


HUNTERS POINT II 




1.77 


.21 


(1) Teacher No. 056 


5 


1.72 


.13 


(2) Teacher No. 057 


19 


1.77 


.20 


+(3) Teacher No. 058 


11 




.26 
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TABLE NO. 23 
CONTINUED 


S.C1IOOL/TEACHER 


S.TUDENT 

N 


MEAN GI.U\UE 
EQUIVALENT 
. SCORE 


STANDARD 

DEVIATION 

V 


JEDEDIAII SMITH 




1.96 


.39 


(1) Teacher No. 067 


12 


1.89 


.31 


(2) Teacher No. 069 


23 


2.01 


.46 


(3) Teacher No. 070 


17 


1.84 


.21 


(4) Teacher No. 071 


24 


2.02 


.42 


SIR FRANCIS DRAKE 




1.87 


.31 


(1) Teacher No. 082 


17 


1.86 


.38 


(2) Teacher No. 083 


20 


1.95 


.28 


(3) Teacher No. 084 


20 


1.83 


.25 


(4) Teacher No. 085 


19 


1.89 


.42 


(5) Teacher No. 086 


19 


1.81 


.16 


+ SPLIT SECOND AND TF 


:RD grade CLASS 


• 
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TABLE NO. 24 

SEED PROJECT THIRD GF^ADE CLASSES: MEAN GILADE EQUIVALl'NT 

SCORE AND STANDARD DEVIATION DY ALL SCHOOLS AND liY TliACilFOiS 

OF INDIVIDUAL SCHOOLS 


SCHOOL/TEACllER 


STUDENT 

N 


MEAN GRADE 
liQUIVALENT 
SCORE 


STANl')ARD 

DEVIATION 


ALL SCHOOLS 


538 


2.56 


.82 


ALL HALLOWS 




3.36 


.76 


(1) Teacher No. 006 


30 


2.98 


. .58 


(2) Teacher No. 007 


30 


3.74 


.72 


BAYVIEW . 




2.45 


.89 


(1) Teacher No. 016 


20 


2.33 


.75 


(2) Teacher No. 017 


22 


2.85 


1.16 


(3) Teacher No. 018 


25 


2.20 


.58 


BRET HARTE 




2.61 


.65 


(1) Teacher No. 029 


17 


2.53 


.70 


(2) Teacher No. 030 


25 


2.60 


.62 


(3) Teacher No. 031 


23 


2.68 


.67 


BURNETT 




2.91 


.83 


(1) Teacher No. 041 


23 


3.38 


1.04 


(2) Teacher No. 042 


21 


2.76 


.69 


(3) Teacher No. 043 


23 


2.88 


.71 


(4) Teacher No. 044 


22 


2.58 


.62 


FREMONT 




2.26 


.63 


+(1) Teacher No. 051 


22 


2.40 


.57 


(2) Teacher No. 052 


22 


2.09 


.69 


(3) Teacher No. 053 


26 


2.28 


.62 


HUNTERS POINT II 




2.39 


.99 


+(1) Teacher No. 058 


9 


1.78 


.26 


(2) Teacher No. 059 


23 


2.19 


.54 


(3) Teacher No. 060 


6 


4.07 


1.29 
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TABLE NO. 7J\ 
CONTINUED 


school/teaciier 


STUDJ'NT 

N 


MEAN 

EQUIVALENT 

SCORE 


STANDARD 

DEVIATION 

V 


JEDEDIAll SMITH 




. -r ....rrrrT j .n n . . 

2.23 


_ t 

1 

.53 


. (1) Teacher No. 072 


18 


2.34 


.64 


(2) Teacher No. 073 


20 


2.33 


.56 


(3) Teacher No. 074 


20 


2.03 


.32 


SIR Fl^NCIS DRAKE 




2.26 


.62 


(1) Teacher no. 087 


21 


2.01 


.31 


(2) Teacher No. 088 


20 


2.26 


.72 


(3) Teacher No. 089 


17 


. 2.88 


.58 


(4) Teacher No. 090 


19 


2.14 


.57 


(5) Teacher No. 091 


14 


2.05 


.44 


+ SPLIT SECOND AND TH 


' 

RD GRADE CLASS 


- 








___is 
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TABLE NO. 25 

SEED PROJl-:CT SECOND GRADE STUDICNTS: W.ITHIN-GRADE CAPACITY 

ESTIMATES OF SEEM) PROJECT SECOND GI'’ADE STUDENTS AND SEED PROJECT 
SECOND GPvADE STUDENTS' STANINE SCORES CLASSIFIED BY \fITllIN-GRADE 
LEVEL GROUPS- -CHI SQUARE TEST OF ASSOCIATION AND CONTINGENCY 
COEFFICIENT C OF CORFsEUCnON FOR ALL SCHOOLS 








STANINE READING SCORE | 


TOTAL 


ABOVE 


AT 
4- -6 


BELOW 

_l-3. 


GRADE LEVEL ESTIMATE 


ABOVE 

7-9 


1 

(2) 


49 

(31) 


17 

(50) 


73 


VO 

H 1 
< 1 


5 

(5) 


49 

(40) 


88 

(97) 


142 


BELOW 

1-3 


1 

(6) 


14 

(51) 


164 

(122) 


179 


TOTAL 


13 


112 


269 


394 







Limitation: Total number of second grade students in SEED Project 
is 624. Students missing one or both scores have been removed from 
calculation of Chi Square. 



CHI SQUARE TEST 


CONTINGENCY COEFFICIENT C 


Chi Square = 119.95 


C = .48 


Ho = Chi Square = 13.28 


C/C max. = .82 


(.01, 4 df) 


•= .59 (3x3) or 59% 


SIGNIFICANT 


' si 
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TABLE NO. 26 



? 







SEED PROJECT THIRD GRAi:)E STUDENTS V;iTH-IN CR^DE CAPACITY 
ESTIMATES OF SEED PROJECT THIRD GRADE STUDENTS AND SEED PROJECT 
THIRD GR/^DE STUDENTS' STANIKE SCORES CIASSIFIED BY WlTHIN-Gl^M)]'. 
LEVEL GROUPS- -CHI SQUARE TEST OF ASSOCI/vTION AND CONTINGENCY 
COEFFICIENT C OF CORRELATION FOR ALL SCHOOLS 








STANINE READING SCORE | 


I TOTAL 


ABOVE 

7-9 


AT S BELOW 1 
4--6 1 1-3 ! 


GRADE LEVEL ESTIMATE 


Or-I 

w 

< 


2 

(1) 


25 

(10) 


14 

(30) 


41 




8 

(6) 


86 

(58) 


146 

(176) 


240 


& 

o 

t^cn 

w 

PQ 


3 

(6) 


12 

(55) 


213 

(167) 


228 


TOTAL 


13 


123 


373 


509 



Limitation: Total number of third grade students in SEED Projecl: 

is 591. Students missing some or both scores have been removed 
from calculation of Chi Square. 



CHI SQUARE TEST 


CONTINGENCY COEFFICIENT C 


Chi Square = 99.12 


C *= .40 


Ho = Chi Square = 13.28 


C/C max. = .40/. 82 


(.01, 4 df) 


= .49 (3x3) cr 497. 


SIGNIFICANT 


s . 
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1 
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TABLE 


NO. I] 






SEKi) j’uaiKCT si;coEi) nnADi'; siAm’.Er.';' and prior yi:ar 


:h;cond 


GliADR STUDl'UTS ‘ 


(;rale KQiji vat,i;::t scores 


ON’ STANFORD : 


READINC; 


Acim:vr,Mi:i>T 


EXAM 1 NAT KjS 


(FO!C*. i;ri!skai,-v;ai.,lis i 


ONE 


WAY ANALYSIS OF VAR1L,.l1, TI.::J RY RANKS---M 






SEED PRmiXlT Sl (:fV,;i) 


I’lnOR ’il'.AU SFXOED 




GRADE sTUi)i;;;rs 


Giu\Di': studi:nts 


scnooi,s 














MEAN CNADl' 




Ml-: AN GRAD): 




RANK 


I'CJU l V.MR-.NT 


lU'.NK 


1-:QUT VALENT 






SCORE 




SCORE 


HAYVILW 


7 


2.03 


1 mmi > 

10 


2.31 


BRET HA RTF 


12.5 


2./<0 


14 


2.62 


BURNE'f’T 


12.5 


2.40 


8 


2.04 


FRE>MONT 


11 


2.34 . 


9 


2.20 


HUNTERS POINT II 


1 


1.77 


2 


1.81 


JEDEDIAH SMITH 


6 


1.96 


3 


1.82 


SIR FRANCIS DRAKE 


4 


1.87 


5 


1.92 


TOTAL RANKS 


54 




51 




RANKS^ 


2916 




2601 




H - 


-.03 










Cht Sq. - 6, 


.64, .01, 1 df. 










£7 




NOT SIGNIFICANT 
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,1,1, — ,.1, — — — 


TABLE NO. 32 






srj'.i) I’Ko.ii-xT TiUKi) GHAri' S'n)n!;HT:; ' and 


PRIOR Yl’AR THIRD 


c;uAi)K STum;i' 


ITS' CRADi'; KQin val):::t sc:ori:s on staneord 


RliA 1)] K’G A Cl 1 1 1: Vi lMF, NT D'AM 1 : : 


/.Tin;; O'orm x) krdskal-v.’Ali/is 


0?'1H VMY ANALYSIS 01 VAR 1 TLST I5Y U/u'3KS---H 






SEED PROJECT TEiRI) 


.PRIOR Vi'AR Tin RD 




Gi^DE s: 


1 UDEN’J S 


CRy\DE STUDIXTS 


SCHOOLS 














MEAN CRAD1-: 




MEAN GI^DR: 




RANK 


EQin VAU'KT 


RANK 


EQUI VAl.r.NT 






SCORl:: 


14 


SCORE 


BAYVIliV; 


8 


2.-!i5 


2.97 


BRHT HARTli: 


10 


2.61 


12 


2.83 


BURNETT 


13 


2.91 


11 


2.79 


FREMONT 


4.5 


2.26 


9 


2.49 


HUNTERS POINT 11 


6 


2.39 


1 


2.09 


JEDEDIAH SMITH 


3 


2.23 


2 


2.13 


SIR FRANCIS DRAKE 


4.5 


2.26 


7 


2.42 


TOTAL RANKS 


49 




56 




RANKS^ 


2401 ' 




3136 





H » -2.19 

- Chi Sq. - 6.6A,. .01, Idf. 
NOT SIGNIFICANT 
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